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RESUME 

L’objet  de  ce  papier  est  de  clarifier  les  rapports  entre 
transformees  d’ondelettes  discretes  et  continues.  Plus 
precisement,  on  s’interesse  aux  liens  entre  deux 
implementations  distinctes  de  la  transforms  d’ondelettes: 
Palgorithme  i  trous  et  la  dsomposition  multiresolution  de 
Mallat.  On  remarque  que  ces  aigorithmes  sont  tous  deux 
des  cas  particulierSd'une  unique  structure  banc  de  filtres, 
appelee  transformee  d’ondelettes  discrete,  dont  le  com- 
portement  depend  du  choix  des  filtres.  Dans  cette 
approche  Palgorithme  a  trous  se  presente  commc  un  algo- 
rithme  multiresolution  non  orthogonal  pour  lequel  la 
transform^  d’ondelettes  discrete  est  exacte.  Un  cadre 
systematique  est  propose  pour  cette  transformee  et  des  con¬ 
ditions  pour  lesquelles  elle  permet  le  calcul  exact  de  la 
transformee  d’ondelettes  continue  sont  etablies. 


I,  INTRODUCTION 

Wavelets  are  rapidly  finding  application  as  a  tool  for 
the  analysis  of  nonstationary  signals  [1].  However,  with  the 
notable  exception  of  orthonormal  wavelets  ([2],  [3]),  very  lit¬ 
tle  literature  has  been  devoted  to  linking  discrete  implemen¬ 
tations  to  the  continuous  transform.  As  in  the  case  of  the 
discrete  Fourier  transform,  these  implementations  (or  filter 
banks)  can,  and  should,  stand  on  their  own  as  abstract 
decompositions  of  discrete  time  series.  Their  wide  sweeping 
significance,  however,  lies  in  their  interpretation  as  wavelet 
transforms.  In  a  general  sense,  this  paper  represents  an 
effort  to  clarify  the  relationship  of  discrete  and  continuous 
wavelet  transforms.  More  narrowly,  it  focuses  on  bringing 
together  two  separately  motivated  implementations  of  the 
wavelet  transform.  One  of  them,  the  algorithme  'a  trous  for 
nonorthogonal  wavelets  ((4),  [5]),  was  developed  for  music 
synthesis  ([IJ)  and  is  particularly  suitable  for  signal  process¬ 
ing.  The  other,  the  multiresolution  approach  of  S.  Mallat 
and  Y.  Meyer,  originally  used  in  image  processing,  employs 
orthonormal  wavelets  [2]  -  [3]. 

A  glance  at  these  two  algorithms  suffices  to  reveal 
closely  related  structures.  In  f.ict,  apurt  from  the  con¬ 
straints  on  their  filters,  the  decimated  a  trous  ([5])  and  Mal¬ 
lat  algorithms  are  identical.  We  arc  thus  led  to  examine  the 
expanded  family  of  algorithms  encompassing  both  types  of 
filters.  The  algorithms  to  be  discussed  all  are  filter  bank 
structures  (see  Figure  1).  Their  only  distinguishing  feature 
is  the  choice  of  two  finite  length  filters,  a  lowpass  filter  f 
and  a  bandpass  filter  g  The  lowpass  condition,  expressed 
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more  precisely  as  E  f^  ■=  V2,  is  necessary  to  the  construc¬ 
tion  of  a  corresponding  continuous  wavelet  function  [3]. 
The  bandpass  requirement,  while  apparently  not  essential  to 
all  applications,  ensures  that  finite  energy  signals  lead  to  fin¬ 
ite  energy  transforms  ([6]).  Under  these  conditions  the 
filter  bank  output  will  be  referred  to  as  the  Discrete 
Wavelet  Transform  (DWT),  a  terminology  which  will 
become  clear  in  the  course  of  the  paper. 

One  class  of  DWT  filter  pairs  are  the  Daubechies 
filters  [3]  which  yield  orthogonal  wavelet  decompositions 
and  constitute,  in  more  conventional  terms,  a  QMF  filter 
bank  with  perfect  reconstruction.  Another  is  that  for  which 
the  lowpass  filter  satisfies  the  'a  trous  condition 
—  #(k)  /V2.  Such  fillers,  which  simply  serve  to  interpo¬ 
late  every  other  point,  correspond  to  a  nonorthogonal 


Figure  1.  A  wavelet  filter  bank  structure.  The  down-arrow  indi¬ 
cates  decimation.  The  output  of  the  transform  is  the  family  of  sig¬ 
nals  w',  forming  the  two  parameter  transform  w,',  in  the  scale-time 
plane.  Following  terminology  to  be  Introduced,  w'  ,s  the 
(dectniated)  discrete  waselet  transform 


wavelet  decomposition.  If  they  are  further  restricted  to  be 
Lhgrangian  interpolators,  they  become  the  squares  of  the 
Daubechies  filters  [6],  which  is  quite  remarkable  in  con¬ 
sideration  of  the  totally  different  derivations. 

A  fundamental  question  is  when  do  these  discrete 
implementations  yield  exact  (i.e.,  sampled)  versions  of  a 
continuous  wavelet  transform?  Aside  from  regularity  condi¬ 
tions  relating  to  smoothness  [3],  we  shall  find  that  if  f  is  n 
trous,  then  the  DWT  coincides  with  a  continuous  wavelet 
transform  by  a  wavelet  g(t)  whose  samples  g(n)  form  the 
filter  g.  Even  if  f  is  not  'a  trous,  the  algorithm  is  exact  pro¬ 
vided  the  signal  lies  in  an  appropriate  subspace;  however, 
in  that  instance,  the  corresponding  wavelet  depends  on  f  as 
well  as  g.  This  is  the  situation  in  the  orthonormal  case 
where,  moreover,  the  filter  g  is  almost  completely  deter¬ 
mined  from  f  through  the  constraints  of  orthogonality. 

II.  TRANSFORM  DEFINITIONS 

The  continuous  wavelet  transform  of  a  signal  s(t) 
takes  the  form 

W(n  ,h)  -  ^  /  g(-^)  s(t)  dt  (1) 

where  g  is  the  analyzing  wavelet,  a  represents  a  time  dila¬ 
tion,  b  a  time  translation,  and  the  bar  stands  for  complex 
conjugate.  The  normalization  factor  l/Vn  is  perhaps  most 
effectively  visualized  as  endowing  |  'W(a,b)  p  with  units  of 
power/hz.  Certain  weak  "admissibility"  conditions  are  usu¬ 
ally  required  on  g(t)  for  it  to  be  a  candidate  for  an  analyzing 

wavelet;  namely,  square  integrability  and  /  -  dw  <  oo 

where  g(u)  is  the  Fourier  transform  of  g(t).  They  insure  that 
the  transformation  is  a  bounded  invertible  operator  in  the 
appropriate  spaces  ([3],  [7]).  If  g(u)  is  ^fferentiable,  then  it 
suffices  that  g  be  zero  mean,  i.e.,  that  J  g(t)dt  —  0. 

We  shall  be  exclusively  concerned  with  discrete  values 
for  a  and  b.  In  particular,  we  assume  that  a  has  the  form 
a  ™  2'  where  i  is  termed  the  octave  of  the  transform.  The 
integral  (1)  then  yields  a  wavelet  series 

W(2',  n)  &  J  g(— ”  )  s(t)  dt.  We  remark  that  finite 

energy  for  the  wavelet  transform  is  not  at  all  equivalent  to 
finite  energy  for  the  wavelet  series.  It  depends  on  the  sam¬ 
pling  grid  as  well  as  the  function  g(l).  Thus,  the  above 
admissibility  condition  is  not  necessarily  appropriate  in  the 
discrete  case  and  should  be  replaced  with  conditions  on  the 
relevant  filters  [6].  In  the  present  paper,  we  shall  take  b  to 
be  a  multiple  of  a 

W(2',  2n)  &  ^  /  g(^  -  n)  s(t)  dt  (2) 

A  logical  step  in  applying  the  theory  to  discrete  sig¬ 
nals  is  to  discretize  the  integral  in  (2) 

w(2'.  2'n)  i  ^  S  g(|  -  n)  s(k)  (3) 

The  sample  rate  has  been  set  equal  to  one.  As  indicated  by 
2'n  on  the  left  hand  side,  (3),  as  well  as  (2),  are  decimated 
wavelet  transforms.  Octave  i  is  only  output  every  2'  sam¬ 
ples  In  this  form  the  resulting  algorithms  will  not  be  trans¬ 
lation  invariant  However,  the  invariance,  which  is  lost  by 


decimation,  is  easily  restored  by  separately  filtering  the  even 
and  odd  sequences  or  by  using  the  algorithm  pictured  in 


Figure  2  (c.f.,(6]). 
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Figure  2.  The  (undecin 

lated)  discrete  wavelet  transform.  The 

filters  D'f  are  obtained  from  f  by  inserting  2'— 1  zeros  between  each 
pair  of  filter  coefficients.  The  operation  of  filtering  is  understood  to 
mean  convolution. 


Proceeding  from  (3),  we  shall  arrive  at  the  DWT  of 
Fig.  1,  namely, 

Is‘]n  -  E  (4) 

-  E  g._j  . 

where  [w*]^  corresponds  to  w(2',  2'n)  of  equation  (3)  and  s° 
is  the  original  signal  s.  The  mysterious  appearance  of  the 
filter  f  in  (4)  will  be  unraveled  in  the  derivation  of  the  'a 
trous  algorithm  in  Section  III.  Finally,  we  shall  come  full 
circle  in  Section  IV  where,  under  quite  general  conditions, 
we  show  the  existence  of  a  function  g(t)  with  g(n)  -  gj, 
and  such  that  the  DWT  acting  on  the  sampled  signal  is 
exactly  the  sampled  output  of  the  continuous  wavelet 
transform  (i.e.,  of  the  wavelet  series). 

Note  that  (1),  (2),  (3)  and  (4)  have  an  analogy  in  the 
Fourier  transform,  Fourier  series,  discretized  z-transform, 
and  the  discrete  Fourier  transform  (DPT).  The  Fourier 
transform  of  a  continuous  signal  s(t),  S(u;)  &  j  e"*^  s(t)  dt, 
is  a  function  of  the  continuous  variable  w.  Restricting  it  to 
a  discrete  (one-dimensional)  grid  results  in  the  coefficients 
of  a  Fourier  series  S(2)rm)  —  j  s(t)  dt,  which  in 

turn  may  be  computed  approximately  by  Si(27rmAt)  — 
s(kM)At,  the  z-transform  of  So  £  s(nAt)  output  at 

discrete  points  If  s(t)  is  band-limited  and  sampled  at 

an  appropriate  rate,  At  —  1/N,  then  the  above  may  be 

computed  exactly  using  the  DFT,  £  e  s^. 

These  transforms  correspond  precisely  to  W(a,  b),  W(2',  n), 
w(2',  n),  and  undecimated  w^.  With  wavelets,  however,  we 
have  the  additional  difficulty  of  dealing  with  a  whole  class 
of  functions  g(t)  rather  than  simply  e'"'.  Also  complicating 
things  are  its  two-parameter  structure  and  the  existence  of 
decimated  versions,  which,  due  to  their  2'n  dependency  on 
i,  play  a  distinguished  role  without  analogy  in  the  one¬ 
dimensional  case. 

Ill  THE  A  TROUS  AND  MALLAT  ALGORITHMS 
Notation 

Signals  and  fillers  in  bold  face  will  be  treated  as  vec¬ 
tors,  in  which  case  •  indicates  discrete  convolution  and 
yields  .^vector.  The  symbol  t  is  used  for  the  adjoint  filter 
(I^)k  ”  f-k-  Dcciin.'ition ,  which  appears  as  a  down  arrow 


in  Fig.  1,  plays  a  pivotal  role  in  all  DWT  algorithms  and  will 
be  'represented  by  a  matrix  -  J(2k  —  j)  where  f(j)  is  the 
Dirac  delta  function.  Also  of  significances  is  its  transpose, 
Dkj  &  S(k  —  2j),  which  dilates  a  vector  by  inserting  zeros. 

The  'a  trons  algorithm 

We  take  the  discretized  wavelet  series  (3)  as  a  starting 
point.  The  difficulty  in  implementing  (3)  is  that,  even  for 
g(t)  of  finite  support,  as  i  increases,  g  must  be  sampled  at 
progressively  more  points,  creating  a  large  computational 
burden.  The  solution  posed  by  [4]  is  to  approximate  the 
values  at  nonintegral  points  through  interpolation  via  a  fin¬ 
ite  filter  f^.  The  resulting  recursion  is  highly  efficient  and 
may  be  implemented  with  the  filter  bank  structure  of  Fig.  1. 

The  interpolation  is  perhaps  best  introduced  with  an 
example.  Let  f^  be  the  filter  (0.5,  1.0,  0.5).  Then, 


2fl_ag(k) 


n  even 

(5) 

n  odd 


approximates  a  sampling  of  g(t/2).  With  the  help  of  the 
dilation  operator  D,  this  may  formalized  as  a  general  pro¬ 
cedure  for  dyadic  interpolation.  The  steps  are  illustrated  in 
Figure  3.  Let  g  be  a  filter  defined  by  g^  -  g(n).  First  we 
spread  g^  to  provide  space  in  which  to  put  the  interpolated 
values.  The  resulting  filter  is  Dg^.  Then  we  apply  a  filter  f^ 
which  leaves  the  even  points  fixed  and  interpolates  to  get 
the  odd  points.  This  condition,  that  f  be  the  identity  on 
even  points,  is  sufficiently  important  to  warrant  a  separate 
definition:  The  lowpass  filter  f  is  said  to  be  an  'a  trous  filter 
it  it  satisfies 

ftk  -  <(k)/V2  .  (6) 


be  rewritten 


s‘+’  -  A  (f  •  s‘)  (9a) 

w*  -  g  •  s'  .  (9b) 

Except  for  decimation  of  the  output,  this  is  the  a  trous 
algorithm  described  in  [4].  Thus,  we  see  that  the  'a  trous 
algorithm  is  simply  a  DWT  for  which  the  filter  f  (an  interpo¬ 
lator)  satisfies  condition  (6)  and  the  filter  g  is  obtained  by 
sampling  an  apriori  wavelet  function  g(t). 

The  Mallat  Algorithm 

With  wi  replaced  by  wj^,,  the  recursions  (9)  coincide 
with  those  of  the  Mallat  algorithm  ([2],  [3]).  As  is  well 
known  ([3]),  in  the  orthonormal  case,  they  provide  the  sam¬ 
pled  output  of  a  continuous  wavelet  transform;  that  is,  w^ 
coincides  with  W(2‘,2*n)  of  (2)  for  suitable  g(t).  More  pre¬ 
cisely,  if  the  filters  f  and  g  satisfy 

Sf2j_n  f2j— m  +  S2j~B  S2i— m  *  ^nm  (1®^) 

Sf2a_jg2m-j  “  0  ,  (10b) 

plus  certain  regularity  conditions,  then 

-  t^)  (11) 

provided  that 

4-1  s(t)  ?(t-k)  ,  (12) 

where  ^  (c.f.,  (14)  below)  is  related  to  g(t)  and  the  filter  g 
by 


The  result  of  the  entire  interpolation  operation,  as  pictured 
in  Figure  3,  is  thus 

(f'*(Dg’)l„  -  SfUg(k)  =  -;^g(n/2)  .  (7) 

ti")  g(-l)  e(0)  6(1)  g(2) 

X  1  w 

Dg'  :  g(-l)  0  g(0)  0  g(l)  0  g(2) 

jf  V2 

*=  6(n/2):  g(-l)  *  g(0)  x  g(l)  x  g(2) 

Figure  3.  Diagram  illustrating  the  dialation  and  interpolation  of  a 
function  g(l)  :  g(n/2)  s:  \/2f^  •  (Dg’). 

Noting  that  g(y  -  n)  -  and  inserting  the 

approximation  (7)  into  (3),  we  obtain 

w(2.  n)  a  S  gm  Si  -  ( g  *  (A(f  •  s))l„  (8) 

k,  m 

which  is  simply  wj,  of  equation  (4)  with  i  -  1.  Continuing 
inductively  bv  replacing  s  in  (8)  with  s‘“',  we  find  that 
w(2’,2'n)  \x,',  for  .ill  i.  where  wj,  is  given  by  (4),  which  can 


g(t)  &  -  E  V2  g_i  ^(2t  -  k)  .  (13) 

It  is  extremely  important  to  note  that,  although  the  discrete 
algorithm  (4)  is  an  exact  computation  of  (11),  the  sampled 
signal  must  lie  in  an  appropriate  subspace  (i.e.,  (12)),  and 
the  relationship  between  g(t)  and  the  filter  g  is  relatively 
complex,  i.e.,  g„  it  g(n). 

IV  THE  DWT  AS  AN  E.VACT  WAVELET  TRANSFORM 

Regardless  of  the  filters  employed,  one  can,  of 
course,  perform  the  recursions  (9)  on  the  sampled  signal  s. 
Moreover,  provided  that  f  is  lowpass  and  g  bandpass,  the 
procedure  may  be  interpreted  physically  as  a  bank  of  pro¬ 
portional  bandwidth  filters  [1],  [6].  In  the  present  section, 
we  examine  the  mathematical  significance  of  relaxing  the 
filter  constraints  (6)  and  (10).  Our  goal  will  be  to  relate  the 
more  general  filter  bank  to  the  continuous  wavelet 
transform,  thus,  in  a  sense,  justifying  the  term  DWT.  In 
this  endeavor,  the  major  questions  which  we  shall  address 
are;  for  what  functions  g(t)  is  the  recursion  (9)  an  exact 
implementation  of  (3)  and  for  which  g(t)  and  s(t)  do  (2)  and 
(3)  coincide?  The  general  answer  is  that  we  arc  able  to  con¬ 
struct  such  a  g(t)  provided  the  discretized  signal  lies  in  the 
subspace  dictated  by  (12).  A  somewhat  surprising  result  is 
that  it  is  necessary  and  sufficient  for  f  to  he  a  trous  for  con¬ 
dition  (12)  to  be  dropped.  Due  to  a  lack  of  space  only  the 
results  will  be  presented.  The  reader  is  referred  to  [6]  for  a 
complete  treatment  including  proofs. 


*  The  discrete  algorithm  is  specified  by  a  signal  s(t)  and 
two  discrete  filters  f  and  g.  The  wavelet  transform  w*  is 
then  determined  from  (9)  and  the  initial  conditions  on  s° 
Our  approach  in  relating  this  recursion  to  a  continuous 
wavelet  transform  is  to  mimic  the  standard  construction  of 
orthonormal  wavelets  [3].  More  precisely,  we  construct  a 
scaling  function  ^(t)  with  Fourier  transform 

&  ft  [^^(1-) 

where  f,(w)  ~  (f^i(w)  is  the  z-transform  of  (Sufficient 
conditions  on  f  for  the  existence,  boundedness,  and 
smoothness  of  ^  may  be  found  in  [3].)  Note  that  for  (14)  to 
converge  to  a  nonzero  function,  the  factors  must  approach 
one;  i.e.,  f,(0)  -  1,  which  implies  Ef^  ->  V2. 

The  obvious  choice  for  s®  is 

s2  &  s(n)  .  (15a) 

However,  we  shall  also  consider 

s®  £  E  ^(k  -  n)  s(k)  ,  (15b) 

which  relates  to  the  discretized  wavelet  series  w(2‘,  2'n),  and 

s2  £  /  ^(t  -  n)  s(t)  dt  ,  (15c) 

which  corresponds  to  the  sampled  WT  (wavelet  series).  For 
a  given  g,  we  shall  construct  a  continuous  function  g(t)  such 
that  the  DWT  of  equation  (9)  is  an  exact  implementation  of 
the  discretized  wavelet  series  under  (15b)  and  of  the  wavelet 
transform  under  (15c). 

Define  g(t)  and  gi(t)  by 

g(t)  6  E  ^(i  +  k)  gk  -  E  ^(t  -  k)  gj  ,  (16) 

k  k 

gi(t)  ^  ^  g(^  -  n)  •  (17) 

The  'a  trous  condition  (6),  f2k  —  plays  a  central  role 

as  a  consequnce  of  the  following  theorem  [6]: 

f  is  an  a  trous  filter  ^(n)  -=  i„o  .  (18) 

This  theorem  implies  that  if  f  is  an  'a  trous  filter,  then  g(t) 
defined  by  (16)  satisfies  g(n)  —  gj.  We  proceed  to  give  a 
summary  of  exactness  results;  i.e.,  conditions  under  which 
the  transforms  W(2',  2'n)  (continuous  signal  and  continuous 
wavelet)  and  w(2',  2‘n)  (discrete  signal  and  continuous 
wavelet)  are  computed  exactly  by  the  discrete  wavelet 
transform  w^  (discrete  signal  and  discrete  wavelet  filters). 
The  proofs  may  be  found  in  (6]. 

Exactness 

Given  discrete  fillers  f  and  g  such  that  ^(l)  of  (14)  is 
well  defined,  define  g(t)  and  g,',(t)  by  (16)  -  (17)  with 
corresponding  sampled  wavelet  transform  (wavelet  series) 

^  j  g,',(t)  s(t)  dt 


and  discretized  wavelet  series 

w(2^  2‘n)  i  E  g‘(k)  s(k)  .  (20) 

Let  4>„  ■  s  stand  for  the  scalar  product  E  ^,(k)Sk,  and 
^d(0  ■  s(0  for  the  scalar  product  /  ^„(t)  s(t).  Then; 

f  is  'a  trous  -c  g(n)  —  gn 

For  s  discrete: 

sj  -  •  s  -<*  w(2‘,  2‘n)  -  w' 

s®  —  s  and  f  is  ‘a  trous  -o  w(2‘,  2‘n)  —  wi  . 

For  s(t)  continuous; 

-  ^,(1)  •  s(t)  «  W(2‘,  2‘n)  -  w‘  . 

Restrictions  on  the  fliter  g 

Restrictions  on  the  filter  g  relate  to  Hnite  energy  and 
admissability,  which,  as  mentioned  in  Section  II,  differ 
from  the  continuous  case.  Constrained  by  space,  we  limit 
ourselves  to  the  following  result  from  [6]:  Let 

||s°°|p  &  lim  sup  ||s‘||^/2'.  A  sufficient  condition 

for  the  undecimated  DFT  w  and  its  inverse  to  satisfy 
A  ||s||*  <  E  ^||w‘||Z  +  ||s~|p  <  B  ||s|p  (21) 

(i.e.,  to  be  bounded  in  an  appropriate  metric)  is  that,  for  all 
w,  |f,(u;)|^  <  2  and 

\  |gi(‘^)l^ 

0  <  A  <  -  <  B  <  oo  .  (22) 

l--||fr(<^)P 

Note  that  a  necessary  condition  for  (22)  to  hold  is 

|f,(w)|  -  2  <=>  g,(w)  -  0,  which  is  very  similar  to  the  con¬ 

tinuous  admissability  condition. 
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